KinjaExtractor - An ‘easy’ way to back-up your posts and images v2

Kinja'd!!! "BvdV - The Dutch Engineer" (dutchengineer)
11/12/2020 at 14:50 • Filed to: None

Kinja'd!!!8 Kinja'd!!! 11
Kinja'd!!!

Horrible potato-picture I took of a Cobra, you know a snake just like a Python

Last year during the previous episode of Kinjapocalypse, I decided to make Just Jeepin’s Python code more accessible for Windows people by turning it into an executable. Now that he fixed the code to work again for current Kinja, I processed his changes to do the same with my program.

!!! UNKNOWN CONTENT TYPE !!!

Like last time, I added the feature of downloading selective articles. By using the selective article feature, you can spare your bandwidth from being clogged by your shitposts, just downloading the posts that matter to you.

A short run-down of the features of KinjaExtractor v2:

Downloading posts as .html and .txt files

Downloading embedded images via the —images function

Downloading a list of all your article urls via the —urls-only option

Downloading select articles from a .txt list via the—article_list option

It can be downloaded using the link below, a zip which includes a read me that explains how to run this from the command line.

https://github.com/bvdv-dutchengineer/kinja-archive/raw/master/kinjaextractor.zip

Happy Extracting!!


DISCUSSION (11)


Kinja'd!!! Horváth Zsolt > BvdV - The Dutch Engineer
11/12/2020 at 15:12

Kinja'd!!!0

Thanks! It’s work, but our blog is hungarian. The html code is perfect

Gusztustalansági verseny

but the downloaded html file is ANSI, not UTF8.
The original article:  https://konc.kinja.com/gusztustalansagi-verseny-1783261215


Kinja'd!!! BvdV - The Dutch Engineer > Horváth Zsolt
11/12/2020 at 15:35

Kinja'd!!!1

Strangely enough when I try your link it fails to fetch it for me. But I will take a look at it, I suspect it might indeed have to do with support for the different symbol set.


Kinja'd!!! PowderHound > BvdV - The Dutch Engineer
11/12/2020 at 15:47

Kinja'd!!!0

I wasn’t going to back up my posts but now I’m seeing some things that I would like to keep… is there a way to backup available for mac?


Kinja'd!!! Horváth Zsolt > BvdV - The Dutch Engineer
11/12/2020 at 16:07

Kinja'd!!!0

Thanks!


Kinja'd!!! BvdV - The Dutch Engineer > PowderHound
11/12/2020 at 16:14

Kinja'd!!!0

I would love to make this work for mac too, but sadly I don’t have one, and Python doesn’t really enable cross platform compilation.

This solution of the same name extracts a html too, but doesn’t download text or pictures automatically:

https://oppositelock.kinja.com/kinjaextractor-another-backup-solution-1845644279

This should work on mac.


Kinja'd!!! Jayvincent > BvdV - The Dutch Engineer
11/12/2020 at 18:21

Kinja'd!!!1

worked like a charm, Thanks!

I used the extract all posts and include images, which put all of my posts into sub-folders by year and sub-sub-folders by month


Kinja'd!!! GLiddy > BvdV - The Dutch Engineer
11/13/2020 at 13:48

Kinja'd!!!0

I just executed it and it works great. Saying that, I’ve already saved my articles another way too and was able to save the comments too, so its not big deal as I can put them together, but...

Is the original script able to pull the comments too? As I said, no biggie, but then I won’t have to manually put it back in.

Yeah, I’m one of those that gets something awesome for free and wants more.


Kinja'd!!! BvdV - The Dutch Engineer > GLiddy
11/13/2020 at 14:39

Kinja'd!!!0

Out of curiosity, what did you use to grab the comments?

Grabbing the comments is hard with this approach, I’m pretty sure it could theoretically  be done, but above my level of coding sadly, and also not include in Just Jeepin’s script.


Kinja'd!!! GLiddy > BvdV - The Dutch Engineer
11/13/2020 at 17:39

Kinja'd!!!0

That’s the thing. I just used the “WE Save Page” plugin for Chrome. It was time consuming but I really haven’t posted much (maybe 30-40) in the time I’ve been here. So I loaded each page, expanded it and then saved it to HTML.

I think Chrome’s “Save Page as” would have worked about the same.


Kinja'd!!! artiofab > BvdV - The Dutch Engineer
11/15/2020 at 08:34

Kinja'd!!!1

I just had a 97% success rate of backing things up with this program and I’m going to share this post to Observation Deck in the hope it helps someone else there.


Kinja'd!!! AnonymousCivilPerson > BvdV - The Dutch Engineer
11/15/2020 at 10:49

Kinja'd!!!1

That worked a Treat! Thank you!